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Abstract —For the case where the dependency digraph has no spanning in-tree, we characterize the 
region of convergence of the basic continuous-time distributed consensus algorithm and show that 
consensus can be achieved by employing the method of orthogonal projection, which has been proposed 
for the discrete-time coordination problem. 

1. INTRODUCTION 

For the coordination algorithms in networked multi-agent systems, conditions of reaching consensus are 
usually formulated in terms of spectral properties of the Laplacian matrix of the dependency digraph. In 
particular, it is well known that for the basic continuous-time protocol, asymptotic consensus is achieved 
for any initial conditions if and only if 0 is a simple eigenvalue of the Laplacian matrix. A necessary and 
sufficient condition of this is [T] the presence of a spanning in-tree in the dependency digraph. If this 
condition is satisfied, then consensus can be expressed [SHI] by the inner product of the left eigenvector 
corresponding to the zero eigenvalue of the Laplacian matrix and the vector of initial opinions. In [UlG], 
it was found that for an arbitrary dependency digraph, the limiting state vector of the above protocol is 
equal to the product of the eigenprojection of the Laplacian matrix, L, and the vector of initial opinions. 
The eigenprojection of L coincides with the stochastic matrix of maximum in-forests of the weighted 
dependency digraph corresponding to the protocol (the forest consensus theorem). An analogous result 
for the discrete-time protocol by DeGroot involves Cesaro averaging. 

In |7|, we proposed the orthogonal projection method for reaching consensus in DeGroot’s protocol 
with a proper (but not necessarily regular) stochastic dependency matrix. In |5|, it has been conjectured 
that this method can be applied to the basic continuous-time distributed consensus algorithm as well. 
The present paper verifies this conjecture. 

In Section[2l we introduce the main notations and preliminaries. Other terminology used in this paper 
can be found in [7|. 


2. BASIC CONCEPTS AND PRELIMINARY RESULTS 
2.1. The continuous-time distributed consensus algorithm 
Consider the basic continuous-time algorithm of consensus seeking in a multi-agent system mis]: 

Xi{t) = Ui(t), (1) 

n 

, i = l,...,n, (2) 

j=i 

where Xi{t) is the state (opinion) of agent i and Uij > 0 is the weight with which agent i takes into 
account the discrepancy with agent j. A = (aij) is the dependency matrix of this algorithm. 

^ This work was supported by the Russian Foundation for Basic Research, projects no. 13-07-00990, 13-01-13105, and 
13-07-13167. 
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The matrix form of the algorithm ([I])-([2]) is: 

x{t) = —Lx{t), (3) 

where x{t) = {xi{t),... ,Xn{t))'^, L is the Laplacian matrix of the algorithm ([II)-© defined by 

L = diag(Al) — A, (4) 

and 1 = (1,..., I)"*". 

A = {ttij) determines the weighted dependency digraph T with vertex set V(r) = {1,..., n} : T contains 
arc (z, j) with weight Wij = aij whenever aij > 0 (i.e., when agent i depends on agent j or, in other words, 
agent j influences agent i). Thus, arcs in T are drawn from dependent agents to the agents that influence 
them; the weight Wij of arc (i,j) is the degree of dependence of i on j. 


2.2. The Laplacian matrix and the matrix of maximum in-forests 


By definition, the Laplacian matrix L of the algorithm ([I])-([2]) has zero row sums, therefore, it is 
singular and 1 = belongs to the null space of L. 

According to Gersgorin’s theorem, the real parts of all nonzero eigenvalues of the matrix (—T) which 
specifies the algorithm ([3]) are strictly negative. 

Suppose that A € is an arbitrary square matrix, TZ(A) and M{A) being the range and the null 

space of A, respectively. Let v = ind A be the index of A, i.e., the smallest A: G {0,1,...} such that 
rankA^"*"^ = rankA^ (A*^ = /, where I is the identity matrix of order n). 

The eigenprojection of matrix A corresponding to the eigenvalu^t) is a projection (i.e., an idempotent 
matrix) Z such that Tl{Z) = J\f{A^) and Af{Z) = TZ{A^). In other words, Z is the projection onto MiA’^) 
along TZ{A‘'). 

It was shown in [8] that the eigenprojection J of L coincides with the normalized matrix J = (jks) of 
maximum in-forests of the digraph T corresponding to L (i.e., of our dependency digraph). The entries 
of J are 



k, s = 1,... ,n, 


where / is the total weightH of all maximum in-forests of digraph T, f^g being the total weight of those 
of them that have k belonging to a tree with root (sink!) s. 


3. CONSENSUS AND FORESTS 

Suppose that the dependency digraph of a multi-agent system has no spanning in-tree or, equivalently 
[U, the Laplacian matrix L of the algorithm ([I])-© has multiple zero eigenvalues. Then [H Theorem 3.12] 
there are vectors of initial opinions such that the algorithm ([II)-® does not lead to consensus. 

Theorem 1 (the forest consensus theorem [5l[6]). Let x{t) be a solution to the system (l3|). Then 

lim x{t) = J a;(0), (5) 

t—¥oo 

where J is the the eigenprojection of L coinciding with the matrix of maximum in-forests J of the depen¬ 
dency digraph T. 

^ Or simply the eigenprojection of A. 

The weight of a digraph (e.g., of an in-forest) is the product of the weights of all its arcs. 
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Theorem [Dean be derived from the expression x{t) = e“^*x(0) for the solution of the system of equa¬ 
tions ([3]) and the identity (see m) 

J = lim (6) 

t^OO 

The result of discretization of the algorithm ([3]) coincides (see m with DeGroot’s iterative pooling 
process [9] 

y(fe) = PV0), A: = 1,2,..., (7) 

where y{k) is the state vector at discrete time k, P is the row stochastic matrix 

P:=I-tL, (8) 

and r > 0 is a sufficiently small parameter. 

Observe that the criterion of stochasticity of the matrix ([8]) is 

0 < r < ^max ^ (S’) 

Let us compare the asymptotic properties of the algorithms ([3|) and dZD- A necessary and sufficient 
condition of the convergence of {P^} is the aperiodicity of P. On the other hand, the Cesaro limit 

k 

P°°:=limiVP* (10) 

fc->-oo k 

1=1 

exists for any stochastic matrix P and coincides with limfc_),oo P^ whenever the the latter limit exists. 
Otherwise, if P is periodic with period s, then P°° = -|- ... J- , where P^^\ ... are 

the limits of the convergent subsequences of {P^}: = limj^oo PP"*"*, i = 1,..., s. 

The following theorem is the discrete-time counterpart of Theorem[T] it can be proved [5] by combining 
a number of known results. 

Theorem 2. Suppose that the sequence y{k) satisfies d?]), where P is determined by (jHj l -ljOj i . Then 

k 

i=l 

where J is the the eigenprojection of L coinciding with the matrix J of maximum in-forests of the depen¬ 
dency digraph T corresponding to L. Furthermore, if Q is satisfied strictly, then 

lim y{k) = J y(0). (12) 

k^oo 

Thus, the main difference between Theorems [1] and [2] is the necessity to use the Cesaro limit when the 
parameter r of (l8|) takes its maximum value ([^. 

4. THE CONSENSUS DOMAIN 

The consensus domain of a coordination algorithm is the set of initial vectors that are led (asymp¬ 
totically) by this algorithm to vectors with equal components, i.e., to consensus vectors. The consensus 
domain of the algorithm Q with matrix L will be denoted by P{L). 
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Theorem 3. For the algorithm ([3]) with matrix L, it holds that 7~(A) = 7^(L) ©span(l), where span(l) 
is the linear span of the vector 1 = (1,... , l)"^. 


The proofs of Theorems[3H6] are given in the Appendix. 

Thus, the basic continuous-time algorithm of consensus seeking ([3]) and the corresponding DeGroot’s 
iterative pooling process ([7|) have the same consensus domain T{L) = TZ{L) © span(l) (cf. [TJ Theorem 1]), 

except for the case where P is not proper, which can only occur when r = ^max, ; i-®-) when 

T reaches its upper bound dH). In this case, only a generalized “Cesaro consensus,” as in (fTT]l . can be 
achieved. Under this generalization, the consensus domain is preserved, as the Cesaro limit coincides 
with the ordinary limit (Theorem[2|) whenever the latter exists. 


5. ORTHOGONAL PROJECTION METHOD EOR THE CONTINUOUS-TIME ALGORITHM 

It follows from the theory of stochastic matrices that convergence to consensus in DeGroot’s iterative 
pooling process ([7|) is guaranteed for any vector of initial opinions y{0) if and only if P is regulaiH. Eor 
the more general case of a propei0 matrix P, we have proposed [ 7 ] the orthogonal projection method, 
which leads to a quasi-consensus. This method consists in: (1) transformation of the vector of initial 
opinions into a vector belonging to the consensus domain of ([ 7 ]) T'{L) = TZ{L) © span(l) by means of 
orthogonal projection and (2) iterative correction of the latter vector by transformation P. 

Let us apply the method of orthogonal projection to the continuous-time consensus algorithm (fT])- ([2|) . 
Then the system of equation ([3|) is preserved, while the vector of initial opinions is transformed, namely 

x(0) = S'x(O), (13) 


where S is the orthogonal projection onto the subspace T(E) = P-iL) © span(l). Then by Theorem[Tl 

lim x{t) = JSx(O). (14) 


Projection S can be computed by means of the following proposition. 

Proposition 1. Orthogonal projection S onto P{L) = P{L) © span(l) has the representation 

S = UiU^U)-^U^, (15) 

where U is any matrix obtained from L by (1) deleting one column corresponding to some vertex of each 
final cksjl of the digraph P corresponding to L and (2) adding 1 as the first column. 


Example 1. Consider the multi-agent system with dependency matrix A given below and find the 
corresponding matrices L = diag(Al) — A and U: 


® A stochastic matrix is called regular [TO] if it has no eigenvalues of modulus 1 except for the simple eigenvalue 1. 
^ A stochastic matrix is called proper if it has no eigenvalues of modulus 1 except for 1. 

® A final class is the vertex set of any bicomponent from which there is no arc directed outwards. 
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Using expressions J = limT-_>.oo(/ + tL) ^ (see (6) in [7]) and (fT5]l one can obtain 
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Since not all rows of J are equal, consensus is not generally achieved. Let us compute 

1 


JS = 1- 


no 


(26 26 13 18 27 0 0) 


1-(0.2364 0.2364 0.1182 0.1636 0.2455 0 0). 


(16) 


The matrix J S enables one to find the quasi-consensus J S'x(O) (see (fTTl) ! of the orthogonal projection 
method for the procedure (fT |) - (l^ . 

6. AN ALTERNATIVE EORM OF THE PROJECTION METHOD 

As was noted in Section^ when the orthogonal projection method is applied to DeGroot’s iterative 
pooling process, the vector of initial opinions x(0) is corrected once by projecting onto T'{L), i.e., it is 
replaced with the vector Sx{Q), where S is the projection (jI5|) : the subsequent correction is performed 
by the initial transformation P. Therefore, the coordination algorithm as a whole is representable as 


x{k) = P^5x(0), 


( 17 ) 
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and the limiting state vector x(oo) in the case of a proper matrix P has the form 

x(oo) = 

Does there exist a matrix P such that the process (I17p has an alternative representation 

x{k) = P’^x{0)7 (18) 

In particular, is the matrix PS suitable for the role of P? The following theorem gives positive answers 
to these questions. 

Theorem 4. If 

P = PS, (19) 

then the coordination algorithm (HHD coincides with the orthogonal projection algorithm (HB. 

It can be observed that the row sums of P = PS are unity, since the projection S does not alter the 
vector 1 € T{L) (and thus, has row sums 1). On the other hand, P is not generally stochastic, since, as 
can be shown by examples, P may have negative entries. 

Does there exist an analogous alternative form of the orthogonal projection method for the continuous¬ 
time procedure ([3])? To construct it, we first define P by means of ([8])~([9]), then compute P = PS, and 
finally, having in mind ([8]), find 

I ■= T-^{I -P) = T-\I -{I- tL)S) = T-\l -S) + LS. (20) 

Let us study the algorithm 


x{t) = —Lx{t) (21) 

which claims to be an alternative form of the projection method for the consensus protocol ([3|). This 
algorithm does not coincide with the projection method, since in the latter, projection (jl3h onto T{L) 
is performed “abruptly,” while the dynamics determined by (1211) is continuous. The matrix L is not 
generally Laplacian: having zero row sums (since I and P have row sums 1), it, as can be shown by 
examples, may have strictly positive off-diagonal entries. Therefore, the terms of control {—Lx{t)) (cf. 
([T])) may not only bring agents’ states closer, but also move them apart. 

In the following theorem, we present some spectral properties of the matrix L. 

Theorem 5. 

1. Let (0,..., 0, Arf+i,..., A„) he the spectrum of L. Then the spectrum of L is (0, t“^, ..., r“^, 

d d—1 

? • • • ? -^n) ■ 

2. JS is the the eigenprojection of L. 

3. is a singular value of L with multiplicity d — 1. 

The following theorem is an analogue of the forest consensus theorem, as it gives an expression for 
the limiting state of the consensus algorithm (I21|) . 

Theorem 6. Let x{t) he a solution of the system (j21|) . Then 

lim x{t) = JSx{0). (22) 
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By Theorem [6l the limiting states of the protocol (I21jl . can be expressed (as well as for the algorithm 
(j3|)) by the product of the eigenprejection of the matrix that determines the algorithm and the vector 
of initial opinions. Theorem [6] is not a corollary of the forest consensus theorem, as L is not generally a 
Laplacian matrix. 

Remark 1. The identity limt_>.oo exp(—Lt) = JS which implies Theorem [6] can also be derived in a 
different way. Using the commutativity of S and LS (since SL = L by Theorem[3]) and the dehnition (j20li 
we have (provided that the limit in the right-hand side exists): 

lim exp {—Lt) = lim exp (—{I — S)T~^t) exp{—LSt). (23) 

t—>-oo t—^oo \ / 

Using the equalities exp(A) = TT’ ~ “ -S', (fe = 2,3,...) it is straightfor¬ 

ward to verify the identities 

exp (—(/— 5)t/T) = S + {I — S) exp {—t/r), 
exp{—LSt) = / — S'-|-exp (—Lt)S'. 

Substituting them into (I23p and using Q and Lemma lA.2l in the proof of Theorem[5]we obtain 
lim exp(—Lt) = lim {S + {I — S) exp(—t/T))(/ — S-|-JS) = SJS = JS, 

t—>-co t—>-oo 

as required. 

Remark 2. In a number of applications of matrix analysis (see, e.g., m, m Chapter 9]) a matrix 
is required which is “the closest” among the matrices of lower rank to a given matrix. The problem 
discussed in this section can be considered as an inverse one: we construct matrices L(r) of rank n — 1 
that belong to the class of matrices with zero row sums (which contains the class of Laplacian matrices) 
and approximate the initial matrix L of lower rank. Consider the following related problem: hnd r > 0 
such that L(r) is the best mean-squared approximation of L. 

Let ||^||_E be the Euclidean norm of X. Using the symmetry of S we obtain 

||L(r)-L||| = \\r-\l - S) + LS - L\\l 

= trace((T-^(/ - S) + LS - L){t-\I - S) + SL^ - L^)) 

= trace(/ — 5) -|- 2r“^ trace((/ — S){LS — L)) + trace((L5 — L){SL^ — L^)). (24) 

Since for every column x of L, it holds that Sx = x (as by Theorem [3l S is the projection onto the 
subspace that contains all columns of L), one has SL = L and SLS = LS, from which it follows that 

trace((/ — S){LS — L)) = trace(LS — L — SLS + SL) = 0. 

Using this expression we have: 

||L(r) — L\\% = trace(/ — S) + trace((LS — L)(SL'^ — L"*")). 

Since the sum of the eigenvalues of / — S is positive (/ — S is a projection all of whose eigenvalues 
are 1 and 0), we have trace(/ — S) > 0. Consequently, ||L(r) — L\\e strictly decreases in r. On the other 
hand, the stochasticity of P restricts the growth of r by (maxj (see ([8]) and ([9])). Therefore, 

we have the following result. 

Proposition 2. ||L(t) — L\\e decreases with the increase of positive r; its infimum is \\LS — L\\e- Un¬ 
der the condition © of the stochasticity of P, the smallest value of ||L(r) — L\\e is achieved when 
T = (maxjX)jViaij)"^- 

Proposition[2]does not imply that L{t) = r“^(/ —S)-|-LS can be equivalently replaced by LS. Indeed, 
such a replacement does not guarantee consensus, as the rank of lim^-^oo exp(—LS't) exceeds 1. 

AUTOMATION AND REMOTE CONTROL Vol. 76 No. 8 2015 




168 


AGAEV, CHEBOTAREV 
7. CONCLUSION 


In this paper, we considered the orthogonal projection method which provides quasi-consensus when 
the continuous-time coordination algorithm fails to produce consensus. We gave a characterization of 
the consensus domain of the basic continuous-time cocoordination algorithm (Theorem[2I), proposed an 
alternative form of the projection method (Section[6|), and characterized the spectrum of the correspond¬ 
ing matrix L (Theorem[5]). An analogue of the forest consensus theorem for the method of orthogonal 
projection has been established (Theorem[6|), a partial result has been obtained on the approximation 
of the initial coordination algorithm by an algorithm leading to a quasi-consensus (Proposition!!]), and 
an alternative form of the projection method has been obtained for DeCroot’s iterative pooling process 
(Theorem Hj). 

It should be noticed that control problems with dependency digraphs having no spanning in-trees (for 
example, in the presence of several static or moving leaders [l3]) have been studied in a number of papers. 
They were mainly concerned with the problems of satisfying certain space constraints, e.g., entering 
some localized region of space or retention in it (this line of research is called “distributed containment 
control”). However, the problem of reaching consensus without creating additional connections have not 
been studied in the papers of that trend known to the present authors. 


APPENDIX 

Proof of Theorem |3l For the algorithm Q with matrix L, consider protocol (|7|) with matrix P 
determined by (|8|) under the assumption that the strict version of (|9|) is satisfied. Then by Theorem]!] (1121) 
holds true. From the fact that liuik^ooUik) exists for any y{0), it follows that the powers of P converge. 
Therefore, by [T] Theorem I] the consensus domain of the algorithm ([7]) is T'{L) = TZ{L) © span(l). 
However, according to m and m, the consensus domains of the algorithms ([3]) and © coincide, 
whence T{L) = IZ{L) © span(l). □ 

Proof of Proposition 111 Since T(L) is also the consensus domain T'{L) of DeGroot’s procedure ©-([8]) 
that satishes the strict version of Q, we can use the expression for the projection onto T'{L) obtained 
in [T] Section 7] and coinciding with (I15h . □ 

Proof of Theorem [H 

The proof is based on the following lemma. 

Lemma A.l. For the matrices P and S determined by Eqs. ([8]) and dUD and any k = 1,2,... , it holds 
that {PS)^ = P^S. 

Proof of Lemma lA.il The trivial {PS)^ = P^S gives the basis of induction {k = I). Let us show that 
SPS = PS. Since S is the projection onto T{L), for any x G M”, Sx G T{L). Consequently, by Theorem[3] 
Sx = Ly + pi with some y G M” and /3 G M. Then PSx = {I — TL){Ly + /31) = L{I — TL)y + ,51 G T{L) 
also by Theorem [3l Therefore, since S is the projection onto T(L), we obtain SPSx = PSx. Since in 
the last equality, x is arbitrary, one has SPS = PS. 

The induction step. Assuming that for some A; > I, (PS)^ = P^S and taking into account the identity 
SPS = PS, we obtain (P5)^+^ = {PS)^PS = P'^S ■ PS = P^PS = P'^+^S. □ 

Using Lemma fA.il for the algorithm (jlSp with matrix ()19p . we obtain: 

x{k) = Px(0) = {PSfx{D) = P^Sx{D), k = l,2,..., 

which coincides with algorithm ()17l) . □ 

Proof of Theorem [5l 1. Let A 7^ 0 be an eigenvalue of L, let x be a corresponding eigenvector. From 

Lx = \x it follows that x G TZ{L), and by Theorem[3l x G T{L) holds. Since S is the projection onto 
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T{L), one has Sx = x. Therefore, we obtain 

Lx = T~^{I — S)x + LSx = T~^{x — x) + Lx = Lx = Xx, 

i.e., x is an eigenvector of L corresponding to the same eigenvalue A. 

Observe that 1 = (1,... , I)"*" is an eigenvector of L corresponding to eigenvalue 0. Indeed, 

LI = T~^{I - 5)1 + LSI = r-^(l - 1) + LI = 0. 

Due to the diagonalizability of any projection, the eigenvectors of S corresponding to different eigen¬ 
values (these are 0 and 1) are linearly independent. Let y G M{S). Since S is symmetric, its rank equals 
the number of nonzero eigenvalues, i.e., rank5 = n — d + 1, while the number of zero eigenvalues equals 
the dimension of M{S). Therefore, it is possible to select d — 1 of such linearly independent vectors y 
and no more. Then, since Sy = 0, one has 


Ly = T - S)y + LSy = T ^y 

and the multiplicity (both algebraic and geometric) of as an eigenvalue of L is d — 1. 

2. By item 1, 0 is a simple eigenvalue of L. 

Lemma A.2. S J S = J S and rank( J 5) = 1. 

Proof of Lemma lA.2l For any x G M"', Sx G T{L) by the definition of S. Then by the definition 
of T(L) and the forest consensus theorem, all the components of J Sx are the same and, consequently, 
rank( J 5) = 1. Moreover, the algorithm ([3]) does not alter the components of J Sx (as it makes the 
right-hand side of ([3]) vanish), therefore, J Sx G T{L). Then S J Sx = J Sx, since 5 is a projection onto 
T{L). By the arbitrariness of x, one has S J S = J S. □ 

Using Lemma lA.2l we obtain 

L(J5) = T-\l -S)JS + LSJS = T-\JS-SJS) + LSJS = t-\J S - JS) + LJS = 0 

and 

{JS)L = T-\JS- JSS) + JSLS = JSLS = 0. 

According to Theorem^ rankL = n — 1, therefore, indL = 1. Since rank(J S) = 1, we conclude (see [14] 
or the characterization (b) in [T5|) that J5 is the eigenprojection of L. 

3. Having in mind that the orthogonal projection S is symmetric, consider the matrix 

LL^ = -S) + LS){t~^{I -S) + SL^) = - S) + LSL^. 

Suppose that rank5 < n and y G J\f{S). Since S is an orthogonal projection, the elements of the null 
space of S are orthogonal to the range of S, which by Theorem [3] includes all the columns of L: L'^y = 0. 
Then 

LL^y = T~^[I - S)y + LSL^y = T~^y, 

i.e., T~^ is a singular value of L. Its multiplicity is d — 1, since it is the dimension of J\f{S), from which 
the vectors y are drawn (see the proof of item 1 of this theorem). □ 

Proof of Theorem m By item 1 of Theorem [S] 0 is a simple eigenvalue of L, while the real parts of 
all other eigenvalues, as well as for L, are positive. The rest of the proof is carried out (using item 2 of 
Theorem [5|) analogously to the proof of Theorem [TJ □ 
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